-
Notifications
You must be signed in to change notification settings - Fork 285
Update variable replacement during deserialization to use replacement settings class and add AKV replacement logic. #2882
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
Conversation
RubenCerna2079
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Still need to get rid of envVar in some places and resolve missing logic inside of an if statement.
souvikghosh04
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
added comments
Aniruddh25
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
The changes look good to me. This is a good refactor. However, unit testing still remains and so does the test in AKV environment.
src/Service.Tests/UnitTests/RuntimeConfigLoaderJsonDeserializerTests.cs
Outdated
Show resolved
Hide resolved
src/Service.Tests/UnitTests/PostgreSqlQueryExecutorUnitTests.cs
Outdated
Show resolved
Hide resolved
|
/azp run |
|
Azure Pipelines successfully started running 6 pipeline(s). |
src/Service.Tests/UnitTests/RuntimeConfigLoaderJsonDeserializerTests.cs
Outdated
Show resolved
Hide resolved
|
|
||
| private static SecretClient CreateSecretClient(AzureKeyVaultOptions options) | ||
| { | ||
| if (string.IsNullOrWhiteSpace(options.Endpoint)) |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Need to test if child configs do infact inherit the akv endpoint values from the parent config - see the multiple configs section of the enhancement.
|
/azp run |
|
Azure Pipelines successfully started running 6 pipeline(s). |
…a-api-builder into dev/aaronburtle/AKVReplacement
|
/azp run |
|
Azure Pipelines successfully started running 6 pipeline(s). |
|
/azp run |
|
Azure Pipelines successfully started running 6 pipeline(s). |
…a-api-builder into dev/aaronburtle/AKVReplacement
|
/azp run |
|
Azure Pipelines successfully started running 6 pipeline(s). |
| // ie: @env('hello@env('goodbye')world') match: 'hello@env('goodbye')world' | ||
| public const string INNER_ENV_PATTERN = @"[^@env\(].*(?=\))"; | ||
| public const string INNER_AKV_PATTERN = @"[^@AKV\(].*(?=\))"; | ||
| public const string INNER_AKV_PATTERN = @"[^@akv\(].*(?=\))"; // changed from [^@AKV\(] |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
| public const string INNER_AKV_PATTERN = @"[^@akv\(].*(?=\))"; // changed from [^@AKV\(] | |
| public const string INNER_AKV_PATTERN = @"[^@akv\(].*(?=\))"; |
| // Note that there is no escape character currently for ')' to exist within the name of the variable. | ||
| public const string OUTER_ENV_PATTERN = @"@env\('.*?(?='\))'\)"; | ||
| public const string OUTER_AKV_PATTERN = @"@AKV\('.*?(?='\))'\)"; | ||
| public const string OUTER_AKV_PATTERN = @"@akv\('.*?(?='\))'\)"; // changed from @AKV to @akv |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
| public const string OUTER_AKV_PATTERN = @"@akv\('.*?(?='\))'\)"; // changed from @AKV to @akv | |
| public const string OUTER_AKV_PATTERN = @"@akv\('.*?(?='\))'\)"; |
seems like copilot made those changes and left comments in your code, which should have been cleaned up before publishing for PR.
Why make this change?
Adds AKV variable replacement and expands our design for doing variable replacements to be more extensible when new variable replacement logic is added.
Closes #2708
Closes #2748
Related to #2863
What is this change?
Change the way that variable replacement is handled to instead of simply using a
boolto indicate that we want env variable replacement, we add a class which holds all of the replacement settings. This will hold whether or not we will do replacement for each kind of variable that we will handle replacement for during deserialization. We also include the replacement failure mode, and put the logic for handling the replacements into a strategy dictionary which pairs the replacement variable type with the strategy for doing that replacement.Because Azure Key Vault secret replacement requires having the retry and connection settings in order to do the AKV replacement, we must do a first pass where we only do non-AKV replacement and get the required settings so that if AKV replacement is used we have the required settings to do that replacement.
We also have to keep in mind that the legacy of the
Configuration Controllerwill ignore all variable replacement, so we construct the replacement settings for this code path to not use any variable replacement at all.How was this tested?
We have updated the logic for the tests to use the new system, however manual testing using an actual AKV is still required.
Sample Request(s)